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Abstract 

We address the count of isolated and embedded eigenvalues in a generalized eigenvalue problem 
defined by two self-adjoint operators with a positive essential spectrum and a finite number of isolated 
eigenvalues. The generalized eigenvalue problem determines spectral stability of nonlinear waves in a 
Hamiltonian dynamical system. The theory is based on the Pontryagin's Invariant Subspace theorem 
in an indefinite inner product space but it extends beyond the scope of earlier papers of Pontryagin, 
Krein, GriUakis, and others. Our main results are (i) the number of unstable and potentially unsta- 
ble eigenvalues equals the number of negative eigenvalues of the self-adjoint operators, (ii) the total 
number of isolated eigenvalues of the generalized eigenvalue problem is bounded from above by the 
total number of isolated eigenvalues of the self-adjoint operators, and (iii) the quadratic form defined 
by the indefinite inner product is strictly positive on the subspace related to the absolutely continuous 
part of the spectrum of the generalized eigenvalue problem. Applications to solitons and vortices of 
the nonlinear Schrodinger equations and solitons of the Korteweg-De Vries equations are developed 
from the general theory. 

Keywords: generalized eigenvalue problem, discrete and continuous spectrum, indefinite metric, invari- 
ant subspaces, isolated eigenvalues, Krein signature 
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1 Introduction 



Stability of equilibrium points in a Hamiltonian system of finitely many interacting particles is defined by 
the eigenvalues of the generalized eigenvalue problem IGK02I . 

Au = -yKu, u G M", (1.1) 

where A and K are symmetric matrices in R"^" which define the quadratic forms for potential and kinetic 
energies, respectively. The eigenvalue 7 corresponds to the normal frequency X = iuj of the normal mode 
of the linearized Hamiltonian system near the equilibrium point, such that 7 = — = w^. The linearized 
Hamiltonian system is said to have an unstable eigenvalue 7 if 7 < or Im(7) / 0. Otherwise, the 
system is weakly spectrally stable. Moreover, the equilibrium point is a minimizer of the Hamiltonian if 
all eigenvalues 7 are positive and semi-simple and the quadratic forms for potential and kinetic energies 
evaluated at eigenvectors of dl.U are strictly positive. 

When the matrix K is positive definite, all eigenvalues 7 are real and semi-simple (that is the geometric 
and algebraic multiplicities coincide). By the Sylvester's Inertia Law theorem I G61I . the numbers of 
positive, zero and negative eigenvalues of the generalized eigenvalue problem dl.ll ) equal to the numbers 
of positive, zero and negative eigenvalues of the matrix A. When K is not positive definite, a complete 
classification of eigenvalues 7 in terms of real eigenvalues of A and K has been developed with the use of 
the Pontryagin's Invariant Subspace theorem |P44|, which generalizes the Sylvester' Inertia Law theorem. 

We are concerned with spectral stability of spatially localized solutions in a Hamiltonian infinite-dimensional 
dynamical system. In many problems, a linearization of the nonlinear system at the spatially localized so- 
lution results in the generalized eigenvalue problem of the form (11.11) but A and K^^ are now self-adjoint 
operators on a complete infinite-dimensional metric space. There has been recently a rapidly growing 
sequence of publications on mathematical analysis of the spectral stability problem in the context of non- 
linear Schrodinger equations and other nonlinear evolution equations ICPV051 IGKP04I IKKS04 , KPOSJ 
IKS05I |P05il . Besides predictions of spectral stability or instability of spatially localized solutions in 
Hamiltonian dynamical systems, linearized Hamiltonian systems are important in analysis of orbital sta- 
bility 10^^871 inS^ITOT . asymptotic stabihty EOllESSDSlEnS, stable manifolds ICCPOgllSUSI . 
and blow-up of solutions in nonlinear equations IPOII . 

It is the purpose of this article to develop analysis of the generahzed eigenvalue problem in infinite di- 
mensions by using the Pontryagin space decomposition IP44I . The theory of Pontryagin spaces was 
developed by M.D. Krein and his students (see books I AI851 RjK691 IIKLH^ ) and partly used in the con- 
text of spectral stability of solitary waves by Mac Kay |M87|, Grillakis fG90|, and Buslaev & Perelman 
IBP93I (see also a recent apphcation in IGKP04I ). We shall give an elegant geometric proof of the Pon- 
tryagin's Invariant Subspace theorem. An application of the theorem recovers the main results obtained in 
ICPV05I IKKS041 FPOSI . Moreover, we obtain a new inequality on the number of positive eigenvalues of 
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the linearized Hamiltonian that extends the count of eigenvalues of the generalized eigenvalue problem. 

The structure of the paper is as follows. Main formalism of the generalized eigenvalue problem is de- 
scribed in Section 2. The Pontryagin's Invariant Subspace theorem is proved in Section 3. Main results 
on eigenvalues of the generalized eigenvalue problem are formulated and proved in Section 4. Section 5 
contains applications of the main results to solitons and vortices of the nonlinear Schrodinger equations 
and solitons of the Korteweg-De Vries equations. 

2 Formalism 

Let and L_ be two self-adjoint operators defined on the Hilbert space X with the inner product (•, •). 
Our main assumptions are listed below. 

PI The essential spectrum of L± in X includes the absolute continuous part <Tc{L±) bounded from 
below by a;+ > and u- > and finitely many embedded eigenvalues of finite multiplicities. 

P2 The discrete spectrum of L± in X includes finitely many isolated eigenvalues of finite multiplicities 
with j»(L-i-) positive, z{L±) zero, and n{L±) negative eigenvalues. 

We shall consider the linearized Hamiltonian problem defined by the self-adjoint operators L± in X, 

Lj^u = —Xw, L-w = Xu, (2.1) 

where A G C and {u,w) £ X x X. By assumption PI, the kernel of L_ is isolated from the essential 
spectrum. Let H be the constrained Hilbert space, 

n = {ueX: M±ker(L_)}, (2.2) 

and let V be the orthogonal projection from X to Tl. The linearized Hamiltonian problem (12.11) for non- 
zero eigenvalues A 7^ is rewritten as the generalized eigenvalue problem 

Au = -fKu, uen, (2.3) 

where A = VL+V, K = VLZ^V, and 7 = -A^. We note that K is a bounded invertible self-adjoint 
operator on 7i, while properties of A follow from those of Finitely many isolated eigenvalues of 
the operators A and K^^ in Ti are distributed between negative, zero and positive eigenvalues away of 
ac{L±). By the spectral theory of the self-adjoint operators, the Hilbert space Ti can be equivalently 
decomposed into two orthogonal sums of subspaces which are invariant with respect to the operators K 
and A: 

n = n-j^®n]^®rQ^^\ (2.4) 
n = n^®n\®rL\®7f/'^\ (2.5) 
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where notation — (+) stands for the negative (positive) isolated eigenvalues, for the isolated kernel, and 
(Te for the essential spectrum that includes the absolute continuous part and embedded eigenvalues. It is 
clear that ae{K) belongs to the interval (0, i^Z^] and ae{A) belongs to the interval [uj^, oo). Since V is 
a projection defined by eigenspaces of L_ while K = VLZ^V, it is clear that dim{7i]^) = n{L^) and 
dim(H+)=p(L_). 

Proposition 2.1 Let uj-^ > 0. There exist uq > 0, zq > 0, and z\ > 0, such that 
dim(7Y^) = n(L+) — no, dim(7Y^) = 2:(L_|_) — + zi, dim(7Yj^) < + no + 2:0 — zi. (2.6) 

Proof. Let ker(L_) = {f 1, f2, Wn} £ and define the matrix-valued function Ai^n): 

^iAV") = ((/" - L+y^Vi,Vj), I <i,j <n 

for all // not in the spectrum of L+. When z{L^) = 0, the first two equalities (12. 6t follow by the abstract 
Lemma 3.4 in ICPV05I . where no is the number of nonnegative eigenvalues of ^(0), zq = 0, and zi is the 
number of zero eigenvalues of ^(0). When z{L^) ^ 0, the same proof is extended for Aq = lim A{fi) 
where zq is the number of eigenvectors in the kernel of in ^ which do not belong to the space 7i 
(see proof of Theorem 2.9 in ICPV05II ). The last inequality in ( I2.6t is obtained by extending the analysis 
of IICPV05I from = to fi = u;+ > 0, where the upper bound is achieved if all eigenvalues of 
A^ = lim A{ii) are negative. ■ 

Since A has finitely many negative eigenvalues and K has no kernel in H, there exists a small number 
(5 > in the gap < 6 < |cr-i|, where cj_i is the smallest (in absolute value) negative eigenvalue of 
K^^A. The operator A + 5K is continuously invertible in Ti and the generalized eigenvalue problem 
(I2.3t is rewritten in the shifted form, 

{A + 5K)u = (7 + 5)Ku, uen. (2.7) 

By the spectral theory, an alternative decomposition of the Hilbert space H exists for < 5 < |(t_i|: 

= '^A+SK ® '^A+SK ® "^A+SK ^ ' (2.8) 

where ae{A + 5K) belongs to the interval [uja+sk^ c«) and uja+5k is the minimum of ac{A + 5K). We 
will assume that uja+sk > for 5 > even if uj^ = 0. 

Proposition 2.2 Let the number of negative (positive) eigenvalues of A + 5K bifurcating from the zero 
eigenvalues of A as 5 > be denoted as n_ fn+j. When loj^ > 0, the splitting is complete so that 

dim(?^^^^^) = dim(?^^) + n±, dim(?^^) = n_ + n+. (2.9) 

When a;+ = and dim(7^^) = 1, the statement remains valid provided that the bifurcating eigenvalue of 
A + 5K is smaller than uja+sk > 0. 
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Proof. For any 5 G (0, |it_i|), the operator A + 6K has no zero eigenvalues in H. The equality (I2.9I) 
follows from the definition of n_ and n+. ■ 



The Pontryagin's Invariant Subspace theorem can be applied to the product of two bounded invertible 
self-adjoint operators {A + 6K)~^ and K in H. 

3 The proof of the Pontryagin's Invariant Subspace theorem 

We shall develop an abstract theory of Pontryagin spaces with sign-indefinite metric, where the main 
result is the Pontryagin's Invariant Subspace theorem. 

Definition 3.1 Let Tibe a Hilbert space equipped with the inner product (•, •) and the sesquilinear form 
[•,-Y- The Hilbert space Ti is called the Pontryagin space (denoted as IXk) if it can be decomposed into 
the sum, which is orthogonal with respect to [•, •], 

7^ = n^ = n+en_, (3.i) 

where 11+ is a Hilbert space with the inner product (•, •) = [•,•], n_ is a Hilbert space with the inner 
product (•, •) = — [•, •], and k = dim(n_) < oo. 

Remark 3.2 We shall write components of an element x in the Pontryagin space IIk as a vector x = 
{rE_,x+}. The orthogonal sum (I3.1I) imphes that any non-zero element a; 7^ is represented by two 
terms, 

Vx G IIk : a; = x+ + x_, (3.2) 

such that 

[a;_|_, = 0, [x+,x_|_]>0, [x_,x_]<0, (3.3) 

and n+ n n_ = 0. 

Definition 3.3 We say that IT is a non-positive subspace ofli^ if[x,x\ < Vx € IT. We say that the 
non-positive subspace U has the maximal dimension k if any subspace of li^ of dimension higher than k 
is not a non-positive subspace o/IIk. Similarly, IT is a non-negative (neutral) subspace o/IIk if [x, x] > 
f [x, x] = Oj Vx G n. The sign of [x, x] on the element xofa subspace H is called the Krein signature of 
the subspace 11. 

Theorem 1 (Pontryagin) Let T be a self-adjoint bounded operator in H^, such that [T-, •] = [•,?"•]. 

There exists a T -invariant non-positive subspace ofli^ of the maximal dimension k. 

'We say that a complex- valued form [it, v] on the product space 7i x 7i is a sesquilinear form if it is linear in u for each fixed 
V and linear with complex conjugate in v for each fixed u. 
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Remark 3.4 There are historically two completely different approaches to the proof of this theorem. A 
proof based on theory of analytic functions was given by Pontryagin IIP44I while a proof based on angular 
operators was given by Krein IGK69II and later developed by students of M.G. Krein IAI86I IIKL82I . 
Theorem [2 was rediscovered by Grillakis IG90I with the use of topology. We will describe a geometric 
proof of Theorem phased on the Fixed Point theorem. The proof uses the Cay ley transformation of a 
self-adjoint operator in to a unitary operator in (Lemma [3.5t and the Krein's representation of the 
maximal non-positive subspace of in terms of a graph of the contraction map (Lemma l3.7t . While 
many statements of our analysis are available in the literature, details of the proofs are missing. Our 
presentation gives full details of the proof of Theorem^ (see IGKP04I for a similar treatment in the case 
of compact operators). 

Lemma 3.5 Let T be a linear operator in Yi^ and z G C, Im(z) > {) be a regular point of the operator 
T, such that z € p(T). Let U be the Cayley transform ofT defined by U = {T — z){T — The 
operators T and U have the same invariant subspaces in n^. 

Proof. Let 11 be a finite-dimensional invariant subspace of the operator T in 11^. It follows from z G p{T) 
that (r - z)n = n then (T - z)-^Yi = li and (T - z){T - zY^Ii C n, i.e UYi C n. Conversely, let 
n be an invariant subspace of the operator U. It follows from U — I = {z — z){T — z)^^ that 1 € p{U) 
therefore n = ([/ - /)n = (T - zy^Il. From there, n C dom(r) and (T - z)n = H so TH C n. ■ 

Corollary 3.6 If T is a self-adjoint operator in li^, then U is a unitary operator in H^. 

Proof. We shall prove that [Ug, Ug] = [g, g], where g S dom([7), by the explicit computation: 

[Ug,Ug] = [{T-z)f,iT-z)f] = [Tf,Tf]-z[f,Tf]-z[TfJ] + \z\^[f,fi 
[g,g] = [{T-z)f,iT-z)f] = [Tf,Tf]-z[f,Tf]-z[Tf,f] + \z\'[f,f], 

where we have introduced / G dom(T) such that f = {T — z)^^g. ■ 

Lemma 3.7 A linear subspace 11 C 11^ is a n-dimensional non-positive subspace ofli^ if and only if it 
is a graph of the contraction maplC:Ii- — > n_|_, such that II = {x-,ICx-} and \\ICx-\\ < 

Proof. Let 11 = x+j be a K-dimensional non-positive subspace of IIk. We will show that there exist 
a contraction map JC : H i—>- 11+ such that 11 is a graph of /C. Indeed, the subspace 11 is a graph of a hnear 
operator JC if and only if it follows from {0, x+j G IT that x+ = 0. Since 11 is non-positive with respect 
to [•, •], then [x, x] = — |p < 0, where || • || is a norm in H. As a result, < ||x+|| < || 

and if x_ = then x+ = 0. Moreover, for any x_ G n„, it is true that ||/Cx_ || < || such that /C is a 
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contraction map. Conversely, let IChe a contraction map fC : n_ i— n+. The graph of )C belongs to the 
non-positive subspace of IIk as 



2 _ = ||/Cx„|P - < 0. 



[x, x] = 

Let n = {x-, /Cx_}. Since dim(n_) = k, then dim(n) = k.^ ■ 

Proof of TheoremQ] Let z G C and Im(z) > 0. Then, z is a regular point of the self-adjoint operator T 
in 11^. Let U = {T — z){T — z)~^ be the Cayley transform of T. By Corollary 13 .61 f7 is a unitary operator 
in IIk. By Lemma l331 T and U have the same invariant subspaces in IIk. Therefore, the existence of the 
maximal non-positive invariant subspace for the self-adjoint operator T can be proved from the existence 
of such a subspace for the unitary operator U. Let x = {x_ , x+} and 



U 



U21 U22 



be the matrix representation of the operator U with respect to the decomposition ( I3.U . Let 11 denote a 
K-dimensional non-positive subspace in H^. Since U has an empty kernel in and U is unitary in 11^ 
such that [Ux-, Ux-] = x_] < 0, then 11 = UH is also a /t-dimensional non-positive subspace of 
n^. By Lemma there exist two contraction mappings /C and K. for subspaces 11 and 11, respectively. 
Therefore, the assignment II = UIl is equivalent to the system. 



K,x^ 



Un Ui2 
U21 U22 



K.X- 



{Uii + C/i2/C)x_ 

{U21 + U221C)X^ 



such that 



U21 + U22IC = IC{Uu + U12IC). 



We shall prove that the operator {Uu + U12IC) is invertible. By contradiction, we assume that there exists 
x_ 7^ such that x- = {Uu + C/i2/C)x_ = 0. Since x_ = implies that x+ = Kx- = 0, we obtain 
that [x-,lCx-Y' is an eigenvector in the kernel of U. However, U has an empty kernel in 11^ such that 
X- = 0. Let F{1C) be an operator-valued function in the form. 



F(/C) = {U21 + U22JC)iUu + U12IC) 



-1 



such that ]C = F{K). By Lemma l3^ the operator F{1C) maps the operator unit ball ||/C|| < 1 to itself. 

Since [/ is a continuous operator and C/12 is a finite-dimensional operator, then U12 is a compact operator. 

Hence the operator ball ||/C|| < 1 is a weakly compact set and the function F{1C) is continuous with 

respect to weak topology. By the Schauder's Fixed-Point Principle, there exists a fixed point /Co such that 

"Extending arguments of Lemma lBTTl one can prove that the subspace 11 is strictly negative with respect to [■, ■] if and only if 
it is a graph of the strictly contraction map K, : IT- i-^ n+, such that It = {x-,K,X-} and ||/Ca;_ || < ||. 
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F(/Co) = /Co and ||/Co|| < 1- By Lemma l3Jl the graph of /Co defines the K-dimensional non-positive 
subspace 11, which is invariant with respect to U. 

It remains to prove that the K-dimensional non-positive subspace 11 has the maximal dimension that a non- 
positive subspace of IIk can have. By contradiction, we assume that there exists a (k + 1) -dimensional 
non-positive subspace 11. Let {ei, 62, e^} be a basis in n_ in the canonical decomposition (13. 2t . We 
fix two elements yi,y2 GU. with the same projections to {ei, 62, e^}, such that 

yi = aiei + 0262 + ... + a^eK + yip, 
2/2 = aiei + 0262 + ... + a^eK + y2p, 

where yip, y2p £11+. It is clear that yi - y2 = yip - y2p E 11+ such that [yip - y2p, yip - y2p] > 0. 
On the other hand, j/i — ^2 G H, such that [yi — y2,yi — 2/2] < 0. Hence yip = y2p and then 2/1 = 2/2- 
We proved that any vector in IT is uniquely determined by the K-dimensional basis {ei , 62, e^} and the 
non-positive subspace IT is hence K-dimensional. ■ 



4 Bounds on eigenvalues of the generalized eigenvalue problem 

We shall apply Theorem^to the product of two bounded invertible self-adjoint operators B = {A+6K)~^ 
and K, where 6 € (0, |i7_i|) and cr_i is the smallest negative eigenvalue of K^^A. Properties of self- 
adjoint operators A and K^^ in Ti follow from properties of self-adjoint operators L± in X, which are 
summarized in the main assumptions P1-P2. With a slight abuse of notations, we shall denote eigenvalues 
of the operator T = BK by A, which is expressed in terms of the eigenvalue 7 of the shifted generahzed 
eigenvalue problem (I2.7t by A = (7 + (5)^^. We note that A here does not correspond to A used in the 
Unearized Hamiltonian problem ( I2.lt . 

Lemma 4.1 Let Ti be a Hilbert space with the inner product (■, •) and B, K : Ti ^ Ti. be bounded 
invertible self-adjoint operators in Ti. Define the sesquilinear form [•, •] = (i^-, •) and extend Ti to 
the Pontryagin space li^, where k, is the finite number of negative eigenvalues of K counted with their 
multiplicities. The operator T = BK is self-adjoint in 11^ and there exists a K-dimensional non-positive 
subspace ofH^ which is invariant with respect to T. 

Proof. It follows from the orthogonal sum decomposition ( I2.4t that the quadratic form {K-, ■) is strictly 
negative on the K-dimensional subspace 7-^^ and strictly positive on the infinite-dimensional subspace 
© Tl'^^^^\ By continuity and Gram-Schmidt orthogonalization, the Hilbert space H is extended 
to the Pontryagin space with respect to the sesquilinear form [•, •] = {K-, •). The bounded operator 
T = BK is self-adjoint in H^, since B and K are self-adjoint in H and 

[T;-] = (KBK;-) = {K;BK-) = [;T-]. 
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Existence of the K-dimensional non-positive T-invariant subspace of follows from Theorem^ ■ 

Remark 4.2 The decomposition (I3.lt of the Pontryagin space IIk is canonical in the sense that 11+ n 
n_ = 0. We will now consider various sign-definite subspaces of 11^ which are invariant with respect to 
the self-adjoint operator T = BK in 11^. In general, these invariant sign-definite subspaces do not provide 
a canonical decomposition of n^. Let us denote the invariant subspace of T associated with complex 
eigenvalues in the upper (lower) half-plane as 71^+ {He-) and the non-positive (non-negative) invariant 
subspace of T associated with real eigenvalues as HniTi-p). The invariant subspace Tin, prescribed by 
Lemma im may include both isolated and embedded eigenvalues of T in IIk. We will show that this 
subspace does not include the residual and absolutely continuous parts of the spectrum of T in 11^. 

4.1 Residual and absolutely continuous spectra of T in 11^ 

Definition 4.3 We say that A is a point of the residual spectrum ofT in 11^ //'Ker(T — A/) = but 
Range(T — A/) ^ IIk and A is a point of the continuous spectrum ofT in 11^ if¥^ei{T — XI) = but 
Range (T - AI) 7^ Range (T - A/) = n«. 

Lemma 4.4 No residual part of the spectrum ofT in IIk exists. 

Proof. By a contradiction, assume that A belongs to the residual part of the spectrum of T in such that 
Ker(r - A/) = but Range(T - A/) is not dense in Let 5 G be orthogonal to Range(r - A/), 
such that 

V/ G n« : = [(T - A/)/,5] = [/, (T - \I)g\. 

Therefore, (T — \I)g = 0, that is A is an eigenvalue of T. By symmetry of eigenvalues, A is also an 
eigenvalue of T and hence it can not be in the residual part of the spectrum of T. ■ 

Remark 4.5 It is assumed in [G90J that the residual part of spectrum is empty and that the kernels of op- 
erators A and K are empty. The first assumption is now proved in Lemma l4!4l and the second assumption 
is removed with the use of the shifted generalized eigenvalue problem (I2.7t . 

Lemma 4.6 The absolutely continuous part of the spectrum ofT in is real. 

Proof. Let P'^ and P~ be orthogonal projectors to n"*" and 11" respectively, such that I = + P~. 

are defined by (•, the self-adjoint operator K admits the polar decomposition K = J\K\, 
where J = P+ — P^ and | is a positive operator. The operator T = BK is similar to the operator 

\K\^^'^BJ\K\^/^ = \K\^^^BJ\K\'^/'^{J + 2P-) = \K\^/^ B\K\'^/'^ + 2\K\'^/'^BJ\K\^^'^P'. 
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Since P~ is a projection to a finite-dimension subspace, the operator \K\^/'^BJ\K\^/'^ is the finite- 
dimensional perturbation of the self-adjoint operator \K\^^'^B\K\^^'^ . By perturbation theory IK76I . the 
absolutely continuous part of the spectrum of the self-adjoint operator is the same as that 

of \K\^/'^ BJ\K\^/'^ . By similarity transformation, it is the same as that of T. ■ 

Lemma 4.7 (Cauchy-Schwartz) Let IT be either non-positive or non-negative subspace o/IIk. Then, 

V/,5Gn: |[/,ff]P<[/,/][5,ff]. (4.1) 

Proof. The proof resembles that of the standard Cauchy-Schwartz inequality. Let 11 be a non-positive 
subspace of 11^, Then, for any /, g e 11 and any a, /3 e C, we have [af + fig, af + (3g] < and 

[af + Pg, af + Pg] = [f, f] jap + [/, g]aP + [g, f\a(i + [g, 5] (4.2) 

If [/, g] = 0, then Oi is satisfied as [/, /] < and [g, g] < 0. If [/, g] / 0, let a G M and 

such that 

[f,f]a' + 2a\[f,g]\ + [g,g]<0. 

The last condition is satisfied if the discriminant of the quadratic equation is non-positive such that 
— /][5f,5] < 0, that is (I4.lt . Let 11 be a non-negative subspace of n^. Then, for any 
/, (7 G n and any a, /? G C, we have [af + (3g, af + f3g] > and the same arguments result in the same 
inequality ( 14. U . ■ 

Corollary 4.8 Let U be either non-positive or non-negative subspace ofH^. Let / G H such that [f, f] = 
0. Then [f, 5] = G H. 

Proof. The proof follows from ( 14.11 ) since < | [/, (?] p < 0. ■ 

Lemma 4.9 Let 11 be an invariant subspace o/Hk with respect to operator T and H'^ be the orthogonal 
compliment o/II in IIk with respect to [•, •]. Then, is also invariant with respect to T. 

Proof. For all / G Dom(T) n H, we have Tf G H. Let g G Dom(r) n Yi^. Then \g, Tf] = [Tg, f] = 0. 



Theorem 2 Let Tie be a subspace related to the absolute continuous spectrum ofT in 11^. Then [/, /] > 

V/ G n,. 
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Proof. By contradiction, assume that there exists /o G He such that [/o, /o] < 0. Since He is a subspace 
for the absolutely continuous spectrum, there exists a continuous family of functions G lie such that 
[/cn /q] < and hence fa € n_ in the decomposition ( I3.U . However, this contradicts to the fact that 
dim(n_ ) = K < oo. Therefore, He is a non-negative subspace of n^. Assume that there exists an element 
/o G He such that [/o, fo] = 0. By Corollary 14.81 /o G H^. By Lemma l4!9l 11^ is an invariant subspace of 
Hk- The intersection of invariant subspaces is invariant, such that lie H 11;^ is a neutral invariant subspace 
of n^. By Lemma im dim(nc n 11;^) < k. Therefore, /o is an element of a finite-dimensional invariant 
subspace of n^, which is a contradiction to the fact that /o G lie. ■ 

4.2 Isolated and embedded eigenvalues of T in 11^ 

Definition 4.10 We say that A is an eigenvalue of T in 11^ if Ker(T — XI) ^ 0. The eigenvalue of 
T is said to be semi-simple if it is not simple and the algebraic and geometric multiplicities coincide. 
Otherwise, the non-simple eigenvalue is said to be multiple. Let Aq be an eigenvalue ofT with algebraic 
multiplicity n and geometric multiplicity one. The canonical basis for the corresponding n-dimensional 
eigenspace ofT is defined by the Jordan chain of eigenvectors, 

/, GH, : Tfj = Xofj + fj-u J = l,-,n, (4.3) 

where fo = 0. 

Lemma 4.11 Let TCx and TC^ be eigenspaces of the eigenvalues A and /i of the operator T in 11^ and 
\^ Jl. Then Tix is orthogonal to with respect to [■,•]. 

Proof. Let n and m be dimensions of Tix and 7-^^, respectively, such that n > 1 and m > 1. By 
Definition l4.10l it is clear that 

/ G Ha ^ (T - XlTf = 0, (4.4) 

5 G ^ (T - ^lI^g = 0. (4.5) 

We should prove that [/, 5] = by induction forn + m > 2. If n + m = 2 (n = m = 1), then it follows 
from the system (I4.4t - (l4.5t that 

(A-/2)[/,ff] =0, /gWa, ffGW^, 

such that [/, g] = for A 7^ fl. Let us assume that subspaces Tlx and are orthogonal for 2 < n+m < A; 
and prove that extended subspaces Ti.x and Ti.^ remain orthogonal forn = n + l,m = m and n = n, 
m = m + 1. In either case, we define f = [T — XI) f and g = {T — iil)g, such that 

/ G TYa ^ (T - A/)"/ = (T - A/)"/ = 0, 
gen^^{T- f,I)^g ={T- f,I)^~g = 0. 
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By the inductive assumption, we have [/, g] = and [/, ^] = in either case, such that 

[(T - XI) f, g] = [/, (T - fil)g] = 0. (4.6) 

By using the system (I4.4l i-( R31 and the relations ( I4.6t . we obtain that 

{X-j2)[f,g]=0, fGHx, geUf,, 

from which the statement follows by the induction method. ■ 

Lemma 4.12 Let Hxg be eigenspace of a multiple real isolated eigenvalue Aq ofT in li,^ and {/i, /2, .../«} 
be the Jordan chain of eigenvectors. Let Tlo = span{/i, /2, fk} C Ti-x^, where k = round(n/2), and 
Ho = span{/i, /2, fk, fk+i} C Haq- 

• Ifn is even (n = 2k), the neutral subspace TCq is the maximal sign-definite subspace ofTCx^^. 

• Ifn is odd (n = 2k+l), the subspace Hq is the maximal non-negative subspace of li^ if [fi , /„] > 
and the maximal non-positive subspace o/IIk if [fi, fn] < 0, while the neutral subspace Hq is the 
maximal non-positive subspace ofn^ if[fi, fn] > and the maximal non-negative subspace o/n^ 

if[fl,fn]<0. 

Proof. Without loss of generality we will consider the case Aq = (if Aq 7^ the same argument is 
applied to the shifted self-adjoint operator f = T - XqI). We will show that [/, /] = V/ G T^o- By a 
decomposition over the basis in Hq, we obtain 

k k 

[/>/] = EE«^«^[/-/i]- (4.7) 

i=l j=l 

We use that 

[fi, fj] = [Tfi+i,Tfj^i] = ... = T^fi+k,T^fj+k = T'^^fi+k,fj+k 

for any I < i, j < k. In case of even n = 2k, we have [fi, fj] = [T^fi+k, fj+k] = for all I < i,j < k. 
In case of odd n = 2fc + 1, we have [fi, fj] = [T^^^ fi^k+i, fj+k+i] = for all I < i, j < k. Therefore, 
Ho is a neutral subspace of TCxq- To show that it is actually the maximal neutral subspace of TCxq, let 
Hq = span{/i, /2, fk, fko}, where k -\- 1 < kQ < n. Since /n+i does not exist in the Jordan chain 
(I4.3t (otherwise, the algebraic multiplicity is n + 1) and Aq is an isolated eigenvalue, then [fi , f„] / by 
the Fredholm theory. It follows from the Jordan chain ( 14.31 ) that 

[f,,fn] = [T'^-'fm, fn] = [fm, T™"^/™] = [fm, /n-m+l] ^ 0. (4.8) 

When n = 2k, we have \ <n — kQ-\-l<k, such that [fkQ, fn-k^+i] 7^ and the subspace Tig is sign- 
indefinite in the decomposition ( 14.71 ). When n = 2 A; + 1, we have l<n — A;o + l<A;forA;o^^ + 2 and 
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n — ko + l = fe+l for A;o = k+1. In either case, [fko, fn-ko+i] the subspace Hq is sign-indefinite 
in the decomposition (I4.7I) unless kQ = k + 1. In the latter case, we have [fk+i, fk+i] = [/i, /n] 7^ and 
[fj, fk+i] = [T^'^/j+fc, fn] = for 1 < j < fc. As a result, the subspace Hq = Hq is non-negative for 
[/i, /„] > and non-positive for [fi, /„] < 0. ■ 

Corollary 4.13 Let Tix^ be eigenspace of a semi-simple real isolated eigenvalue Aq ofT in li^. Then, 
the eigenspace Hx^ is either strictly positive or strictly negative subspace ofH^ with respect to [•, •]. 

Proof. The proof follows by contradiction. Let / be a particular linear combination of eigenvectors in 
TYao' ^^^^ that [/, /] = 0. By the Fredholm theory, there exists a solution of the Jordan chain (14.31) . where 
/i = /. Then, the eigenvalue Aq could not be semi-simple. ■ 

Remark 4.14 If Aq is a real (multiple or semi-simple) embedded eigenvalue of T, the Jordan chain can 
be truncated at /„ even if [/i, /„] = 0^. In the latter case, the neutral subspaces Tip for n = 2k and 
TIq for n = 2A; + 1 in Lemma 14.121 do not have to be maximal non-positive or non-negative subspaces, 
while the subspace "Haq in CoroUarv 14. 13l could be sign-indefinite. The construction of a maximal non- 
positive subspace for (multiple or semi-simple) embedded eigenvalues depend on the computations of the 
projection matrix [/«,/,] in the eigenspace of eigenvectors Tlx = span{/i, ...,/„}. We shall simplify 
this unnecessary compUcation by an assumption that all embedded eigenvalues are simple, such that the 
corresponding one-dimensional eigenspace Tix^ is either positive or negative or neutral with respect to 
[v]. 

Remark 4.15 By Lemma l4. 12l and Corollary 14. 131 if Aq is a real (multiple or semi-simple) isolated eigen- 
value, then the sum of dimensions of the maximal non-positive and non-negative subspaces of Tix^ equals 
the dimension of Tix^ (although the intersection of the two subspaces can be non-empty). By Remark 
14.141 the dimension of Tix^ for a real embedded eigenvalue can however be smaller than the sum of di- 
mensions of the maximal non-positive and non-negative subspaces. Therefore, the presence of embedded 
eigenvalues introduces a complication in the count of eigenvalues of the generalized eigenvalue problem 
(12. 3t . This complication was neglected in the implicit count of embedded eigenvalues in IKKSOill. 

Lemma 4.16 Let Aq € C, Im(Ao) > G be an eigenvalue of T in IIk, corresponding 
eigenspace, and Hxq = { > J" ^'^^ neutral subspace Hxq is the maximal sign-definite 

subspace ofHxQ, such that [/, /] = V/ € 'Hx^- 

Proof. By Lemma |4.1 II with A = /x = Aq, the eigenspace Tix^ is orthogonal to itself with respect 
to [•,•], such that TYaq is a neutral subspace of TYaq- It remains to prove that TIxq is the maximal sign- 
definite subspace in Hx- Let T^Ao == span{/i, /2, /„}, where {/i, /2, fn} is the Jordan chain of 
^^The Fredholm theory gives a necessary but not a sufficient condition for existence of the solution fn+i in the Jordan chain 
<4.3t if the eigenvalue Aq is embedded into the continuous spectrum. 



13 



eigenvectors (I4.3I) . Consider a subspace Hq = span{/i, /2, /„, /,}, where 1 < j < n and construct a 
linear combination of fn+i-j and 

[/n+i-i + afj,fn+i-j + a/j] = 2Re {a[fj,fn+i-j]) , a G C. 

By the Fredholm theory, [/„, /i] / and by virtue of (I4.8t . [/j , 7^ 0. As a result, the linear 

combination fn+i-j + a/j is sign-indefinite with respect to [•, •]. ■ 

Lemma 4.17 Let T-Lq be eigenspace of a multiple zero eigenvalue of K~^A in Ti and {fi, fn} be the 
Jordan chain of eigenvectors, such that fi G Ker(j4). Let < 5 < |cr_i|, where a^i is the smallest 
negative eigenvalue of K^^A. If uj+ > then [/i, /„] = {Kfi, fn) 7^ 0, and 

• If n is odd, the subspace Tio corresponds to a positive eigenvalue of the operator (A + 6K) if 
[/ii fn] > and to a negative eigenvalue if[fi, fn] < 0. 

• If n is even, the subspace Tio corresponds to a positive eigenvalue of the operator {A + 6K) if 
[/ii In] < and to a negative eigenvalue if [fi, fn] > 0. 

Proof. Let fi{5) be an eigenvalue of the operator A + 6K related to the subspace TCq. By standard 
perturbation theory for isolated eigenvalues IK76L each eigenvalue fJ-j{5) is a continuous function of 6 
and 

lim ^ = (-1)^+1 (-^/i^/n). (4.9) 

If LO^ > 0, the zero eigenvalue of A is isolated from the essential spectrum of K^^A, such that [fi, fn] = 
{Kfi, fn) by the Fredholm theory. The statement of the lemma follows from the limiting relation 
( I4.9t . Since no eigenvalues of K~^A exists in (— (T_i,0), the eigenvalue n{6) remains sign-definite for 
< 6 < \a-i\. m 

Remark 4.18 The statement holds for the case lo^ = provided that n = 1, [/i, fi] ^ 0, and fi{6) < 
uja+5k^ where loa+sk > is defined below the decomposition ( I2.8I ). 

Remark 4.19 We are concerned here in the bounds on the numbers of eigenvalues in the generalized 
eigenvalue problem (I2.3t in terms of the numbers of isolated eigenvalues of self-adjoint operators A and 
K~^. Let Np (Nn) be the number of negative eigenvalues of the bounded or unbounded operator K~^A 
with the account of their multiplicities whose eigenvectors are associated to the maximal non-negative 
(non-positive) subspace of li^ with respect to [•, •] = {K-, ■). Similarly, let A'^ (-^n) be the number of 
zero eigenvalues of K~^A with the account of their multiplicities and N:^ (N^) be the number of positive 
eigenvalues of K~^A with the account of their multiplicities, such that the corresponding eigenvectors 
are associated to the maximal non-negative (non-positive) subspace of 11^. In the case of real isolated 
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eigenvalues, the sum of dimensions of the maximal non-positive and non-negative subspaces equals the 
dimension of the subspace ^-Lx^^ by Remark l4.15l The splitting of the dimension of 7i\^ between Np{Xq) 
and A'„(Ao) is obvious for each semi-simple isolated eigenvalue Aq in Corollarv l4.13l In the case of a 
multiple real isolated eigenvalue Aq of algebraic multiplicity n, the same splitting is prescribed in Lemma 

KM 

(i) Un = 2k,ke N, then Np{Xo) = iV„(Ao) = k. 

(ii) If n = 2A; + 1, /c G N and [fijn] > 0, then Np{\o) = /c + 1 and iV„(Ao) = k. 

(iii) If n = 2fc + 1, € N and [/i, /„] < 0, then A^p(Ao) = k and A^„(Ao) = k + 1. 

In the case of a simple real embedded eigenvalue Aq, the numbers A'p(Ao) and A'„(Ao) for a one- 
dimensional subspace Hxg are prescribed in Remark l4. 14l as follows: 

(i) If [/i, /i] > 0, then iVp(Ao) = 1, A^n(Ao) = 0. 

(ii) If [/i, /i] < 0, then iVp(Ao) = 0, iV„(Ao) = 1. 

(iii) If [/i, /i] = 0, then iVp(Ao) = iV,(Ao) = 1. 

In the case (iii), the sum A'p(Ao)+A'^„(Ao) exceeds the dimension of Hx^ - Let (A'^^-) be the number of 
complex eigenvalues in the upper half plane 7 G C, Im(7) > (Im(7) < 0). The maximal sign-definite 
subspace of associated to complex eigenvalues is prescribed by Lemma l4TT6l 

Theorem 3 Let assumptions P1—P2 be satisfied. Eigenvalues of the generalized eigenvalue problem \2.3\ 
satisfy the pair of equalities: 

iV- + iVO + iV+ + iV,+ = A\m{n-j,^sK) (4-10) 
N- + N^^ + N+ +N,+ = dim(7^]^) (4.11) 

Proof. We use the shifted eigenvalue problem ( I2.7t with sufficiently small 5 > and consider the 
bounded operator T = {A + 5K)~^K. By Lemma ^3 the operator T is self-adjoint with respect to 
[•, •] = {K-, ■) and it has a non-positive invariant subspace of dimension k = dim('H^). Counting all 
eigenvalues of the shifted eigenvalue problem (I2.7t in Remark 14.191 we establish the equality (14.1 It . 
The other equality (14. lOt follows from a count for the bounded operator T = K{A + 5K)^^ which is 
self-adjoint with respect to [•, •] = ((^4 + 5K)~^-, ■). The self-adjoint operator (^4 + 5K)^^ defines the 
indefinite metric in the Pontryagin space where h = dim(7^^^^j^). For any semi-simple eigenvalue 
70 of the shifted eigenvalue problem \2.1\ . we have 

V/, <7 € n^,, {{A + 5K)f,g) = (70 + S){Kf,g). 
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If 7o ^ or Im(7o) 7^ 0, the maximal non-positive eigenspace of T in associated with 70 coincides 
with the maximal non-positive eigenspace of T in 11^. If 70 < 0, the maximal non-positive eigenspace 
of T in ITk coincides with the maximal non-negative eigenspace of T in n^. The same statement can be 
proved for the case of multiple isolated eigenvalues 70 when the eigenspace is defined by the Jordan block 
of eigenvectors, 

Afj = joKfj + fj-i, j = 1, n, 

where /o = 0. The dimension of the maximal non-positive eigenspace of T in 11^ is then + N^^ + 
N+ + N,+ . U 

Corollary 4.20 Let N^cg = '^i™(^A+<5_ft') ~^ dim(7^^) be the total negative index of the shifted general- 
ized eigenvalue problem \2. 71 ). Let A^unst = +'^^c+ total number of unstable eigenvalues 
that include = + N~ negative eigenvalues 7 < and Nc = + N^- complex eigenvalues 
with Im(7) 7^ 0. Under the assumptions of Theorem^ it is true that 

AN = iV„eg - A^unst = 2N+ + 2N^ > 0. (4.12) 

Proof. The equahty (I4.12t follows by the sum of (I4.10t and (I4.1U . ■ 

Theorem 4 Let assumptions P1—P2 be satisfied and ojj^ > 0. Let = dim(7^^ © Ti^ © '^\) the 
total number of isolated eigenvalues of A. Let Nk = <Xmi{H~^ © T~C^) be the total number of isolated 
eigenvalues of K. Assume that no embedded eigenvalues of the generalized eigenvalue problem ( 12.31 ) 
exist. Isolated eigenvalues of the generalized eigenvalue problem (12.31 1 satisfy the inequality: 

N- + + N+ + <Na + Nk. (4. 13) 

Proof. We prove this theorem by contradiction. Let 11 be a subspace in 11^ spanned by eigenvectors 
of the generalized eigenvalue problem (12. 3t which belong to negative eigenvalues 7 < 0, zero 
eigenvalues 7 = 0, A'^^ positive isolated eigenvalues < 7 < uj-^lo-, and complex eigenvalues 
Im(7) > 0. Let us assume that iVp"+iV°+iV++A'c+ > Na+Nk- By Gram-Schmidt orthogonalization, 
there exist a vector /i in 11 such that {h, /) = and (/i, g) = 0, where / G © © TL\ and 
gen]^®nj^, such that h G H^J;^'^^ n n''j^^^\ As a result, 

{Ah,h) >Lo+{h,h), {Kh,h) <ujZ^{h,h), 

and 

{Ah, h) > uj^uj^[Kh, h). 
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On the other hand, since G 11, we represent h by a linear combination of the eigenvectors in the 
corresponding subspaces of 11, such that 



{Ah,h) = aiaj{Ahi, h 



= ^ aiaj{Ahi,hj) + ^ aiOj^Ahi, hj) + ^ OiOj^Ahi, hj), 

7i=7j<0 7i=7i=0 0<7i=7j<(^+aj_ 

where we have used Lemma l^.lll and Corollarv l4.16l By Lemma R-.12l the non-zero values in {Ahi, hj) 
occur only for eigenvalues with odd algebraic multiplicity n = 2A; + 1 for eigenvectors {Afk+i, fk+i), 
where f^+i is the generalized eigenvector in the basis for TYq- Since all these cases are similar to the case 
of simple eigenvalues, we obtain 

{Ah,h) = \aj\'^{Ahj,hj) + \aj\'^(Ahj,hj) + ^ {ajl"^ {Ahj , hj) 

7j<0 7j=0 0<7j<w+a;_ 

= 7i!ajf + Yl lMj\^iKhj,hj) 

7j<0 0<7j<a;+a;_ 

< tj+w- \aj\^{Khj,hj), 

0<7j<w+a;_ 

where we have used the fact that {Khj , /ij ) > in 11. On the other hand, 

{Kh,h) = aiaj{Khi, hj) 

= Y.\aj\''iKh,,hj)+Y,\(^j\HKh,,hj)+ Yl \(^3?{Khj,hj) 

7j<0 7j=0 0<7j<W4.toi_ 

> w,WKh,,h,). 

0<7j<a;+aj_ 

Therefore, {Ah, h) < LO+uj-{Kh, h), which is a contradiction. ■ 

Corollary 4.21 Let A'^totai = + be the total number of isolated eigenvalues of operators A and 
K. Let iVisoi = N~ + N:^ + + + N:^ + N:^ + iVc+ + N^- be the total number of isolated 
eigenvalues of the generalized eigenvalue problem M.3\ . Under the assumptions of Theorem^ it is true 
that 

iVisoi < A^totai + dim(7i^) . (4. 14) 



Proof. The inequality (I4.14t follows by the sum of (14.1 It and (I4.12I) . ■ 

Remark 4.22 If a simple embedded eigenvalue with the corresponding eigenvector /i is included into 



consideration according to Remark 14. 191 then the left-hand-side of the inequality (14. 13t is increased by 
the number of simple embedded eigenvalues with [/i, /i] < 0. For each embedded eigenvalue, the right- 



hand-side in the inequality (14. 14t is reduced by two if [fi, /i] < and it remains the same if [/i, /i] > 0. 
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5 Applications 



We shall describe three apphcations of the general analysis which are related to recent studies of stability 
of solitons and vortices in the nonlinear Schrodinger equation and solitons in the Korteweg-de Vries 
equation. 

5.1 Solitons of the scalar nonlinear Schrodinger equation 

Consider a scalar nonlinear Schrodinger (NLS) equation, 

i,Pt = -A^ + F(IV^p)^, A = dl^,^ + ... + dl,^, (5.1) 

where {x,t) G M'^ x M and ip ^ C For a suitable nonlinear function where F is C°° and 

F{0) = 0, the NLS equation ( I5.lt possesses a solitary wave solution tp = (/)(x)e*'^*, where to > 0, 
(f) : ^ M., and (j){x) is exponentially decaying function. See IM93 1 for existence and uniqueness 
of ground state solutions to the NLS equation (I5.lt . Linearization of the NLS equation (I5.lt with the 
anzats, 

^ = (^(j)[x) + [u{x) + iw{x)]e^^ + [u{x) + ra(x)]e^*) e*"^*, (5.2) 

where A G C and (n, w) G C^, results in the linearized Hamiltonian problem (I2.lt . where L± are 
Schrodinger operators, 

L+ = -A + a; + F(</.2) + 2</)2f'(02), (5.3) 
L_ = -A + u; + F{())^). (5.4) 

We note that L± are unbounded operators and (Tc{L±) = [u, oo) with uj^ = = w > 0. The kernel of 
L_ includes at least one eigenvector </)(x) and the kernel of L+ includes at least d eigenvectors dxj4'{x), 
j = 1, d. The Hilbert space X is defined as ^ = H^{W^, C) and the main assumptions P1-P2 are 
satisfied due to exponential decay of the potential functions F{4P') and cfP'F' {(jp'). Theorems |3] and |4] 
give precise count of eigenvalues of the stability problem L_L_|_n = —\^u, provided that the numbers 
dim(7^]^), dim(7-^^^^^), Nk and Na can be computed from the count of isolated eigenvalues of L±. 
We shall illustrate these computations with two examples. 

Example 1. Let cf){x) be the ground state solution such that (j){x) > on x G W^. By spectral theory, 
Ker(L_) = {(j){x)] is one-dimensional and the subspace Ti'j^ in ( I2.4t is empty, such that the correspond- 
ing Pontryagin space is Ho with k = 0. 

• By the equality dTTTl . it follows immediately that N~ = = N:^ = = such that the 
spectrum of the problem (12.31) is real-valued and all eigenvalues are semi-simple. 
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• Since eigenvectors of Ker(A) are in the positive subspace of K, the number of zero eigenvalues 
of the problem (O is given by iV° = dim(n°^). If ^||0||^2 = 0, then = -(pix), 
dw4>{x) G 'H, V4> = 0, and the eigenvector d^(f){x) G Ker(7'L+7'), such that zi = 1. If z{L^) = 
d, then zq = since dxj(t>{x) G H for j = 1, ...,d. In particular, L^Xj(j){x) = —2dxj4>{x) and 
(/^a,.,0,9,^.</.) = i||0||2, >0. 

• By the equality (I4.10t . the number of negative eigenvalues of the problem (I2.3I) is given by Np = 
dim(7Y^^^^). By Lemma |4. 1 71 with n = 1 and > 0, all zero eigenvalues of A become 
positive eigenvalues of ^ + 6K for (5 > 0. By Propositions 12. Il and l2.21 we have dim(7-^^^^^) = 
dim(?^^) = n(L+) - no- By Theorem 3.1 in IGSS90J . no = 1 if £;\\(p\\l2 > and no = 
otherwise. 

• By the inequality ( I4.13I ). the number of positive eigenvalues of the problem ( 12.31 ) are bounded from 
above by N+ < dim(Hjj) + dim(7Yj). By Proposition O it is then < p{L+) + p{L^) + 
no + Zq- Zi. 

Remark 5.1 Under the assumptions that n(L+) = 1, = d, p{L+) = p{L^) = and ^||</'||^2 < 

0, it follows from the above properties that A'^" = 1, A'^ = d, and A^" = 0. The assumptions n(L_|_) = 1, 
z{L^) = d and ^ ||<^||^2 < are verified for the super-critical NLS equation with the power nonlinearity 
F = \ip\P IIS05I . Under the further assumptions p{L^) = p{L^) = 0, the statement A'^^ = is proved 
directly in Proposition 2.1.2 [ POll and Proposition 9.2 [KS05J for d = 1 and in Lemma 1.8 [IS05I for 
d = 3. The same statement follows here by the count of eigenvalues from Theorem 0] 

Remark 5.2 Systems of coupled NLS equations generaUze the scalar NLS equation (I5.lt . Stability of 
vector solitons in the coupled NLS equations results in the same linearized Hamiltonian system (12. U 
with the matrix Schrodinger operators L±. General results for non-ground state solutions are obtained 
in IIKKS04I IP05I for d = 1 and in ICPV05I for d = 3. Multiple and embedded eigenvalues were either 
excluded from analysis by an assumption IIP05IICPV05I or were treated implicitly IIKKS04I . The present 
manuscript generalizes these results for an abstract case with a precise count of multiple and embedded 
eigenvalues. 

Example 2. Let the scalar NLS equation (I5.lt with F = IV'I^ be discretized with A = eAdiso where 
Adisc is the second-order discrete Laplacian and e is a small parameter. We note that /S.^\sc is a bounded 
operator and crc(— Ajisc) £ [0, ^d]. By the Lyapunov-Schmidt reduction method, the solution ijj = (()e^^* 
with Lij > bifurcates from the limit e = with A^ non-zero lattice nodes to e / 0, such that ^ ||0||p > 0, 
ker(L+) = 0, and ker(L_) = {<f)} is one-dimensional for < |e| < eo with eo > (see I.PKF06al for 
d = 1 and IIPKF()6bl for d = 2). By the equalities (HOOl and (HTTlTi . we have 

N-+N+ + N,-, = n(L+)-l, 



19 



N-+N+ + N,+ = n{L_), 



where n(L+) = and n{L^) < — 1 in the domain < |e| < eo- When small positive eigenvalues 
of L_ are simple for e 7^ 0, it is true that N+ = n{L^), = = 0, and Np = N - I - n{L_) 
(see Corollary 3.5 in IPKF06al '^). It is clear that the Lyapunov-Schmidt reduction method gives a more 
precise information on numbers A^^, A'^", and N^+, compared to the general equalities above. Similarly, 
by the inequality ( 14.131) and the counts above for < |e| < eo, we have 

N+ < 2n(L_) + dim(Hj) + dim(H^). 

When < |e| < eo, the numbers N^^ and dim{TC\) give precisely the numbers of edge bifurcations from 
the essential spectrum of K~^A and A respectively, while the number dim(7-^^) exceeds the number of 
edge bifurcations from the essential spectrum of K^^ by A^ — 1 — n{L^). When the solution 1?!) is a ground 
state, we have A^ = 1 and n{L^) = 0, such that the edge bifurcations in the spectrum of K^^A may only 
occur if there are edge bifurcations in the spectrum of A and K^^ for e 7^ 0. When A^ > 1, the relation 
between edge bifurcations in the self-adjoint and non-self-adjoint problems become less direct. 

Remark 5.3 The Lyapunov-Schmidt reduction method was also used for continuous coupled NLS equa- 
tions with and without external potentials. See rK K04l IKK06I IPY05II for various results on the count of 
unstable eigenvalues in parameter continuations of the NLS equations. 

5.2 Vortices of the scalar nonlinear Schrodinger equation 

Consider the scalar two-dimensional NLS equation (I5.lt with d = 2 in polar coordinates (r, 9): 

i^t = -A^ + F(|^|2)V., A = dl + ^dr + ^dlg, (5.5) 

where r > and 6 e [0, 2tt]. Assume that the NLS equation (15.51 ) possesses a charge-m vortex solution 
ip = (j){j.'^f,ime+iujt ^ where a; > 0, m G N, (/> : M+ M, and 0(r) is exponentially decaying C°° function 
for r > with 0(0) = 0. See IPW02II for existence results of charge-m vortices in the cubic-quintic NLS 
equation with F = — IV'P + IV'I^- Linearization of the NLS equation \5.5\ with the anzats, 

^ = (</,(r)e^™^ + v^+(r,0)e^* + (^_(r,0)e^*) e'^\ (5.6) 

where A € C and ((/?+,(/?_) e C^, results in the stability problem, 

a^H^p = iX(fi, (5.7) 

''Corollary 3.5 in rP KF06al is valid only when small positive eigenvalues of L_ are simple. It is shown in IPKF06bl that 
the case of multiple small positive eigenvalues of L- leads to splitting of real eigenvalues N~ of the generalized eigenvalue 
problem <2.3> to complex eigenvalues beyond the leading-order Lyapunov-Schmidt reduction. The case of multiple small 
negative eigenvalues of L- does not lead to this complication since the semi-simple purely imaginary eigenvalues do not 
split to complex eigenvalues . 
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where = (^3+, (/3„)'^, 0-3 = diag(l, —1), and 
Expand <^{r, 9) in the Fourier series 

and reduce the problem to a sequence of spectral problems for ODEs: 

<^^Hn^ri = ^^Vn. n G Z, (5.8) 

■ / (n+m) (n—m)\T^ , 

where ip,^ = ((^^ ) > and 

When n = 0, the stability problem (15.81 transforms to the linearized Hamiltonian system (12. U . where 
L± is given by ( I5.3t -( I5^ with A = d"^^ + ^dr — ^ and (u, w) are given by u = (^^"^ + ip^~"^^ 
and w = —i{ip^^^ — ip[_ ™^). When n € N, the stability problem (15. 8t transforms to the linearized 
Hamiltonian system i2.ll with = i7„ and L_ = a^HnCrs, where 



L+ = L^ + 2(t?F'{(t)^)ai, ai 



1 

1 



and (u, ^y) are given hy u = ^p^ and w = —ia^'Pn- When —n € N, the spectrum of the stability problem 
(15. 8t can be obtained from that for n G N by the correspondence H^n = ci-f^nCi- 

Let us introduce the weighted inner product for functions on r > 0: 

if, a) = / f{r)g{r)rdr. 



Jo 

In all cases n = 0, n € N and — n G N, L-t are unbounded self-adjoint differential operators and 
ac{L±) = [uj, oo), such that = = w > 0. The kernel of includes at least one eigenvector for 

n = ±1 

0±i = 0'(r)l T -<^(r)a3l, 1 = (1,1)^, 
r 

and at least one eigenvector for n = 0: cf)^ = (p{r)as'i- The Hilbert space X associated with the weighted 
inner product is defined as ;f = H^{R+,C) for n = and X = H'^{R+,C'^) for ±n e N. In all cases, 
the main assumptions P1-P2 are satisfied due to exponential decay of the potential functions F{4>'^) and 

</.2F'((/)2). 

The case n = is the same as for solitons (see Section 5.1). We shall hence consider adjustments in the 
count of eigenvalues in the case ±n € N, when the stability problem (15. 8t is rewritten in the form, 

I a,H^p^=^Xp^ ^^^^ 
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Let L_(_ be a diagonal composition of Hn and and L_ be a diagonal composition of a^HnCr^ and 

Lemma 5,4 Let A an eigenvalue of the stability problem rt5.9l l wjY/j f/ie eigenvector 0). T/iew f/iere 
another eigenvalue —A w/f/i f/ie linearly independent eigenvector (0,cri(^„). //'Re(A) > 0, there 
exist two more eigenvalues A, —A with the linearly independent eigenvectors (0, cji^„), 0). 

Proof. We note that aia^ = —a^ai and uf = (Tg = do, where fio = diag(l, 1). Therefore, each 
eigenvalue A of Hn with the eigenvector generates eigenvalue —A of with the eigenvector 
= '^iVn- When Re (A) 7^ 0, each eigenvalue A of Hn generates also eigenvalue —A of Hn with 
the eigenvector ^„ and eigenvalue A of H^n with the eigenvector 93 _„ = cri<^„. ■ 

Theorem 5 Let N^^ai be the number of real eigenvalues in the stability problem ( 15. 91) with Re (A) > 0, 
-^comp be the number of complex eigenvalues with Re(A) > and Im(A) > 0, N^^^^ be the number 
of purely imaginary eigenvalues with Im(A) > and {ipn^Hn'^n) — 0' '^'^^ -^zcro algebraic 
multiplicity of the zero eigenvalue ofa^Hnfn — ^'^Vn counted in Remark [4.19\ Assume that all embedded 
eigenvalues are simple. Then, 

^iVreai + iVcomp = n(F„) - - Nr^^^, (5.10) 

where Nj-ea\ is even. Moreover, hq = n_, where uq and n_ are defined by Propositions \2.1\ and \2.2\ 

Proof. By Lemma a pair of real eigenvalues of a^Hn^Pn = i^'Pn corresponds to two linearly 
independent eigenvectors ipn and Because {Hni^n^ Vn) real-valued and hence zero for A G M, we 
have 

By counting multiplicities of the real negative and complex eigenvalues of the problem (I2.3t associated 
to the stability problem (I5.9t . we have N^^ = = N^cai and = 2Ncomp- By Lemma a pair of 
purely imaginary and zero eigenvalues of the stability problem (I5.9t corresponds to two linearly indepen- 
dent eigenvectors 0) and (0, where = a^Pn and {H_n^_n, = {Hn^Pn, ^n)- By 
counting multiplicities of the real positive and zero eigenvalues of the problem (I2.3t associated to the sta- 
bility problem ( I5.9t . we have Nn = '2N~j.^ and N^^ = 2N^^^. Since the spectra of Hn, (JiHnCfi, 
and a3Hn<T3 coincide, we have n{L^) = n{L ) = 2n{Hn). As a result, the equality (I5.10t fol- 
lows by the equality (14.1 It of Theorem |3] By Lemma 15.41 the multiplicity of A'^rcai is even in the sta- 
bility problem ( 15. 9t . The other equality ( 14. lOt of Theorem |5] recovers the same answer provided that 
dim(7-^^_(_^^) = dim(?-^^) + n_ = n(-L+) — no + n_ = n(L+), such that no = n_. ■ 

Example 3. Let (f){r) be the fundamental charge-m vortex solution such that (/)(r) > for r > and 
4>{Q) = 0. By spectral theory, Ker(iJo) is one-dimensional with the eigenvector (pQ. The analysis of n = 
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is similar to Example 1. In the case n € N, we shall assume that Kev{Hi) = {4>i} and Ker(if„) = 
for n > 2. 

• Since {(J34>i, 0i) = and Ker((T3ffi(73) = {(730^ }, then (p^ G H, such that zq = 0. 

• By direct computation, {asHia-i)^^(f)i = —^r(f>{r)l and 

/■oo 

((a3i?ia3)-Vi, 0i) = / r</.2(r)dr > 0. 
Jo 

By Lemma 14.171 we have N^l = n_ = for n = 1, as well as for n > 2. By Proposition 12. II we 
have A{0) < such that no = zi = for all n € N. 

• By Theorem |5j we have 

Aureal + 2iVcomp = 2n(i/„) - 2N.-^^^. (5. 11) 

If all purely imaginary eigenvalues are semi-simple and isolated, A^^^g gives the total number of 
eigenvalues in the stability problem i5.9i with Re (A) = 0, Im(A) > 0, and negative Krein signature 

Remark 5.5 Stability of vortices was considered numerically in IPW02I . where Lemma 15^ was also 
obtained. The closure relation (15.1 II) was also discussed in |KKS04] in a more general context. De- 
tailed comparison of numerical results and the closure relation ( 15. lU can be found in IK05I . Vortices 
in the discretized scalar NLS equation were considered with the Lyapunov-Schmidt reduction method in 
IPKF06bll . Although the reduced eigenvalue problems were found in a much more complicated form com- 
pared to the reduced eigenvalue problem for solitons, the relation ( 15. lit was confirmed in all particular 
vortex configurations considered in IPKF06bl . 

Remark 5.6 Since A'^reai is even, splitting of simple complex eigenvalues A'^comp into double real eigen- 
values A'rcai is prohibited by the closure relation (15.1 II) . Simple complex eigenvalues may either coalesce 
into a double real eigenvalue that persists or reappear again as simple complex eigenvalues. 

5.3 Solitons of the fifth-order Korteweg-De Vries equation 

Consider a general fifth-order KdV equation, 

vt = aiVx - a2Vxxx + asVxxxxx + 3bivVx - 62 {w^xx + "^v^V:;,:,) + Gbsv'^Vx, (5.12) 

where (ai, 02, 03) and {bi, 62, ^3) are real-valued coefficients for linear and nonlinear terms, respectively. 
Without loss of generality, we assume that 03 > and 

Cwave(A:) = ai + a2k'^ + a^k^ > 0, VA; G M. (5.13) 
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For suitable values of parameters, there exists a traveling wave solution v{x, t) = (j){x — ct), where c > 
and </) : R 1-^ M, such that the function (j){x) is even and exponentially decaying as |x| oo. Existence of 
traveling waves was established in llZH7llHS881|AT92ll for 62 = ^3 = 0, in ICG97I for 63 = 0, in IK^ 
for 61 = —62 = ^3 = 1, and in IL99II for 63 = or 61 = 62 = 0. Linearization of the fifth-order KdV 



equation (I5.12t with the anzats 

v{x, t) = (p{x — ct) + w{x — ct)e^^ 

results in the stability problem 

d^L^w = Xw, (5.14) 
where L_ is an unbounded fourth-order operator, 

d d 

^ "^dx^ ~ "^cfa?2 + «i + c + 3bi(f){x) - ^2^</'(a;)^ - b2(f>"{x) + 663(^)^(3;). (5.15) 



With the account of the condition (I5.13t . the continuous spectrum of L_ is located for ac{L^) € [c, 00), 
such that a;_ = c > 0. The kernel of L_ includes at least one eigenvector (p'{x). Since the image of L_ 
is in L^(M), the eigenfunction w{x) € for A / satisfies the constraint: 

{l,w) = I w{x)dx = 0. (5.16) 



Let w = u'{x), where u{x) — > as |x| — 00 and define L+ = —dxL-dx- The continuous spectrum of 
L+ is located for ac{L^) e [0, 00), such that 0;+ = 0. The kernel of L+ includes at least one eigenvector 

(t){x). 

Let the Hilbert space X be defined as ^ = C). The main assumptions P1-P2 for L_ and L+ 



are satisfied due to exponential decay of the potential function 4'{x). The stability problem (I5.14t is 
equivalent to the linearized Hamiltonian system (I2.lt . The operator L_ defines the constrained subspace 
Ti and hence the Pontryagin space 11^ with k = n{L^). The operator has the embedded kernel to the 
endpoint of the essential spectrum of L+. This introduces a technical complication in computations of the 
inverse of -L+ IKP05I . which we avoid here with the use of the shifted generalized eigenvalue problem 
iUl with (5 > 0. It is easy to estimate that 



(^A+SK = inf 



^wave ik)) + 



5 

> - > 0, 
c 



C + Cwave (^) . 

where uja+5K is defined below the decomposition ( I2.8t . Theorem |5] can be applied after appropriate 
adjustments in the count of isolated and embedded eigenvalues in the stability problem ( I5.14t . Since 
w+ = 0, Theorem]?] is not applicable to the fifth-order KdV equation (I5.12t . Because the continuous 
spectrum of dxL^ is on A G iE, all real and complex eigenvalues are isolated and all purely imaginary 
eigenvalues including the zero eigenvalue are embedded. 
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Lemma 5.7 Let Xj be a real eigenvalue of the stability problem \5.14\ with the real-valued eigenvector 
Wj{x), such that Re(Aj) > and Im(Aj) = 0. Then there exists another eigenvalue —Xj in the problem 
\5.14l with the linearly independent eigenvector Wj{—x). The linear combinations w^{x) = Wj{x) it 
Wj{—x) are orthogonal with respect to the operator 

(L_wf,wf)=±2p,, (l_u;J,u;±) =0, (5.17) 

where pj = {L^Wj{—x),Wj(x)). 

Proof. Since 4'{—x) = </>(x), the self-adjoint operator L_ is invariant with respect to the transformation 
X i—f —X. The functions Wj(x) and Wj{—x) are linearly independent since Wj{x) has both symmetric and 
anti-symmetric parts provided that Xj / 0. Under the same constraint, 

{L-Wj{±x),Wj{±x)) = ^Xj^ {L^Wj{±x),dxL-Wj{±x)) = 0, 

and the orthogonality relations (I5.17t hold by direct computations. ■ 

Corollary 5.8 Let Xj be a complex eigenvalue of the stability problem ( 15. 141 with the complex-valued 
eigenvector Wj{x), such that Re(Aj) > and Im(Aj) > 0. Then there exist eigenvalues Xj, —Xj, 
and —Xj in the problem ( 15.741 1 with the linearly independent eigenvectors Wj{x), Wj{—x), and Wj{—x), 
respectively. 

Lemma 5.9 Let Xj be an embedded eigenvalue of the stability problem ( 15. 14i with the complex-valued 
eigenvector Wj{x), such that Re(Aj) = and Im(Aj) > 0. Then there exists another eigenvalue 
—Xj = Xj in the problem ( 15.741 1 with the linearly independent eigenvector Wj{—x) = Wj{x). The linear 
combinations w^{x) = Wj{x) =b idj{x) are orthogonal with respect to the operator L_, 

(^L_wf,wf)=2pj, (^L_wJ,wf) =0, (5.18) 

where pj = Re {L-Wj{x),Wj{x)). 

Proof. Since operator L_ is real- valued, the eigenvector Wj{x) of the problem (I5.14t with Im(Aj) > 
has both real and imaginary parts, which are linearly independent. Under the constraint Aj ^ 0, 

{L_Wj,Wj) = Xj^ {L^Wj,dxL_Wj) = 0, 

and the orthogonality equations (I5.18t follow by direct computations. ■ 

Theorem 6 Let A'rcai be the number of real eigenvalues of the stability problem ( 15.741) with Re (A) > 0, 
-^'comp be the number of complex eigenvalues with Re(A) > and Im(A) > 0, and N^^^ be the number 
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of imaginary eigenvalues with Im(A) > and pj < in HS.lSi . Assume that all embedded (zero and 
imaginary) eigenvalues of the stability problem ( 15.741) are simple, such that Ker(L-(_) = {0} E Ti. Then, 

Aureal + 27Vcomp + 2Nr^^^ = n{L_) - N-,, , (5.19) 

where N~j.^ = 1 if{LZ^(t>, 0) < and N^j.^ = otherwise. 

Proof. Each isolated and embedded eigenvalue jj = — of the generalized eigenvalue problem i2.3l is 
at least double with two linearly independent eigenvectors u^{x), such that = dxU^- By Lemma I5j1 
and Corollary 15. 8 1 the dimension of non-positive invariant subspace of IIk for isolated (real and complex) 
eigenvalues coincide with the algebraic multiplicities of isolated eigenvalues, such that A'^^ = A'^" = 
A^rcai and = 2A'comp- By convention in Remark |4. 141 all embedded (zero and purely imaginary) 
eigenvalues are assumed to be simple. By Lemma 15.91 and the relation for eigenvectors of the stability 
problem (I5.14t . 

(L+n, u) = {L^u', u') = {L^w, w), (5.20) 
we have N+ = 2Nr^^^ and iV° = N^^^^. The count ( l5l9l follows by equahty d^UT i of Theorem |3] ■ 

Remark 5.10 Theorem|6lcan be generalized to any KdV-type evolution equation, when the linearization 
operator L_ is invariant with respect to the transformation x i— > —x. When N-^^.^^ = N^^ = 0, the relation 
( I5.19t extends the Morse index theory from gradient dynamical systems to the KdV-type Hamiltonian 
systems. For gradient dynamical systems, all negative eigenvalues of L_ are related to real unstable 
eigenvalues of the stability problem. For the KdV-type Hamiltonian system, negative eigenvalues of L_ 
may generate both real and complex unstable eigenvalues in the problem (I5.14t . 

Example 4. Let (/)(x) be a single-pulse solution on x S ffi (which does not have to be positive). Assume 
that the operator L_ has a one-dimensional kernel in X with the eigenvector (/>'(x). Then the kernel of 
is one-dimensional in X with the eigenvector (pix), such that z{L^) = 1. 

• Since (0, (f>') = 0, then Ker(L_|_) G 7i and zq = 0. Since L-dc4>{x) = —4>{x), we have zi = 1 if 
^||0|[^2 = 0. Since the latter case violates the assumption that the embedded kernel is simple in 
H, we shall consider the case ^||0|||2 7^ 0, such that zi = 0. 

. Since {K(l),c^) = -(9,0,0) = -^^UWh^ ^e have A^",, = 1 if fj^, > and N-,, = 
if ^||0||i2 < 0. By Lemma I4T7] and Remark HTTSl dim{n^^^j^) = dimin^) + N'^^^. By the 
relation ( 14.101 ) of Theorem |51 with Np = A^rcab we have 

Aureal + 2Ar,omp + 2A^;,,g = dim{n^^sK) - ^zero = diuiiH^). (5.21) 
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• Recall that dim(7^^) = n{L^) — uq in Proposition 12. II (extended to the case 6<j_|_ = 0). By the 
Sylvester Inertia Law Theorem and the relation (I5.20t . we have n{L^) = n{L^) in X. Since 
A{0) = —{Ll^^(f)', cj)') = —{LZ^4>, (jy), we have no = in Ti. As a result, the relation ( I5.2U 

recovers the same equality ( I5.19I ). 

Remark 5.11 General stability-instability results for the traveling waves of the KdV-type equations were 
obtained in IIBSS87I when n(L_) = 1. In this case, iVcomp = A^^ag = ^reai = 1 - 
A'^ero' such that stability follows from ^||<A|Il2 > and instabihty follows from ^||</'|||2 < 0. By a 
different method, Lyapunov stability of positive traveling waves was considered in LW87J . Specific 
studies of stability for the fifth-order KdV equation ( I5.12t were reported in IIS92||DK99I with the energy- 
momentum methods. Extension of the stability-instability theorems of IBSS87IIW87II with no assumption 
on a simple negative eigenvalue of L_ was developed in IL991 IP03I with a variational method. The 
variational theory is limited however to the case of homogeneous nonlinearities, e.g. 63 = or 6i = 
62 = 0. Our treatment of stability in the fifth-order KdV equation (15.121) is completely new and it exploits 
a similarity between stability problems of KdV and NLS solitons. The pioneer application of the new 
theory to stability of N-solitons in the KdV hierarchy is reported in IKP05I . Further progress on the same 
topic will appear soon in lBCD06lfS06l . 
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